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ABSTRACT 

This document discusses several of the most 
significant analytic meanings to te found in enrollment data, with 
the expectation that some of th§ * already developed analytic toqls, 
vhen properly tuned, can be applied to enrollment and similar data. 
The Induced Course Load Matrix (ICLMJ, is a theoretical concept 
developed from situations in business^ and industry wheyre talk is of 
inputs and outputs. The input in this document is students, faculty 
and staff, facilities, and finances. However, students, faculty, and 
staff are also decisiop makers and cannot be manipulated in the same 
vay as more tangible variables used in business. After consideration j 
of enrollment data and the Induced Load Matrix it appeals evident * 
that the ICLH is best skirted to macro-level analysis and decision 
making. The document then attempts to develop a micro-level tool that 
can be employed in j the study of retention and attrition rates in 
enrollment and is useful for data requiring longitudinal study, such 
as enrollment statistics that take Into account peer group 
influences. In conclusion, answers _such as those sought above cannot 
be found in the fatfiliar aggregate numbers game* It is more likely A 
that one or more management science tools will play a : part in the 
answers sought. (Author/KE) 
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FOREWORD 

This paper was originally prepared as a staff report by the University 
of Toledo Office of Institutional Research of which Mr. Hill is Associate 
Director. It was presented to the Joint Conference of The Operations Re- 
search Society of America, The Institute of Management Sciences, and The 
Systems Group of the American Institute of Industrial Engineers at Atlantic 
City, New Jersey, November 8-10, 1972. Both of these presentations/were 
under the. title, "Finding Analytic Meaning in Enrollment Matrices." Its 
publication by >e Business Research Center of The University of Toledo 
College of Busfness Administration, in which Mr. Judd is Professor of Oper- 
ations Analysis, is in theNnterest of obtaining wider circulation and 
comment among those interested in this vital issue in college administra- 
tion. 

The research reported here is presently being extended under the dir- 
ection of Rrofessor Judd through, this office in cooperation with the Office 
of Institutional Research. This extension is an attempt' to address the 
question of "Why do students leave?" 



Thomas A. Klein 

Director, Business Research Center 
February 8, 1973 
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Finding Analytic Meaning in Enrollment Matrices ^ 

Finding analytic meaning in enrollment matrices is somewhat like finding 
a single oak tree in a forest. There are so many oak trees, the process of 
deciding on one may be tortuous. And there are so many possible analytic find- 
ings in enrollment data as to make the choice of one or even a few difficult. 
This paper enlarges upon work of the first author begun when he served as 
Registrar and coincidental ly, serves to extend the work of the second author. 1 
Since not every analytic meaning to be found in enrollment data can possibly 
be discussed, several of the most significant are presented in this paper. 

\ 

ICLM Model Possibilities 

Projecting resource requirements through the use of Induced Course Load 
Matrix (ICLM) models has become quite fashionable. At least it has become 
fashionable^ believe that ICLM is capable of predicting resource requirements. 
The National Center for Hisfier^Education Management Systems at WICHE utilizes 
the concept in their Resource Requirements Prediction Model (RRPM). 2 Califor- 
nia State University, Fullerton, incorporated ICLM into their pilot test of 
several NCHEMS techniques. 3 The Pennsylvania State University model does not. 
use the term "ICLM" but nevertheless employs the same concepts for use in 
predicting instructional activity. H 

ICLM is a theoretical concept, conceptualized from situations in business 

and industry where we talk of inputs and outputs. In business and industry 

one can establish, with almost unfailing certainty, the various outputs that 

will result from the introd»ct1on of various inputs. The inputs of sand, gravel, 

cement, and water into the mixer produces an output of concrete, the properties 

of which can be determined through input variation. The decision to use Type II 

Cement rather than Portland Cement produces certain predictable results. 

NOTE: The authors want to acknowledge the slgnifitmt help of Ronald L. Webster 
and Dean A. Berkey, Programmer-Analysts, and Thomas J. Greene, Mgr. Application 
Systems, University of Toledo Computer Services on this research project. 



Input into the educational "mixer, 11 the university, consists of, at 
least, students, faculty and staff, facilities, and finances. However, where 
inputs of sand, gravel, cement, and water are manipulated by the decision- 
maker responsible for the output, some inputs to the educational system (i.e. 

students, faculty and staff) are also decision-makers and as a result cannot - 

i 

be manipulated in the same manner possible in producing concrete. 

In an attempt to minimize the impact of decision-making on the part of 
students, the concept of the student flow model has been utilized. 5 Using 
historical data, retention and attrition are analyzed by major and student 
level in order to determine the major and level movement from period to per- 
iod for student body. Thus, the probabilities that become associated with 
groups of students (e.g., freshmen history majors) are based on the actual 
experience of each freshman history major in the period under analysis. Each 
student has decision possibilities and his decisions are then combined with 
those of all others in his group to form the basis for assignment of proba-/ 
bilities for decisions that will be made by a subsequent group of students 
assigned to the same classifications as were the students whose performance 
determined the probabilities. 

Each student has identical decision possibilities but different proba- 
bility possibilities. Exhibit 1 (top row and left column) shows the decision 
making situation confronting each student. Each will, in fact, make a deci- 
sion, but given a large enough group of decision makers, the results of their 
actions individually will tend to be distributed in such a manner that the 
probabilities are considered as accurate indicators of student flow. For any 
individual student his probabilities are based on items quite apart from the 
decisions of similar students in the analysis; his probabilities are based 
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EXHIBIT 1 



DECISION 
POSSIBILITIES 


A 

KEEP MAJOR 


B 

CHANGE MAJOR 


C 

QUIT SCHOOL 




1 

KEEP LEVEL 


P 1A 


".B 




p 1 


2 

CHANGE LEVEL 


P 

2A 


P 

2B 


p 

2C 






P A 


P B 




x 1 .00 

\ 



PROBABILITIES: 

Pj A - of keeping level and keeping major 

P 1B " of kee P in 9 'cvel and changing major 

P 1C " of < l ulttin 9 school before completing level 

P 2A - of changing level and keeping major 

P 2B - °f changing level and changing major 

P 2C of < l ulttln 9 school at completion of level 

Pj - of keeping level 

?2 - °f changing level 

P^ - of keeping major 

i 

P^ - of changing major 
P^ - of quitting school 

c 

' 7 
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on items important to him, such as grades, financial resources, and emotional 
maturity, to name a few. 

Two, requirements of successful student flow modeling are a large enough 
population and condition of "all other things being equal" from the period of 
basing the probabilities to the period of prediction. Assuming that the stu- 
dent flow model properly distributes our student body, we must then again rely 
on historical data to develop the ICLM. \ 

Just as the student flow probabilities were determined as the result of 
actual decisions of students made on the basis of personally influencing fac- 
tors, the ICLM is the result of decisons v made in a prior time-decisions .based 
on available facilities, finances, faculty and staff, and previous result^ 
obtained by the students (e.g., grade earned^from a certain instructor). \As 
we shall see, administrative decision-making can have a pronounced effect Ipn 
course enrollments. Furthermore, we shall see tha} largeness of numbers 1^ 
necessary to make the ICLM appear to work but that when a microanalysis is 
performed on actual data at The University of Toledo the ICLM does not per- 
form satisfactorily. 

FreshMtn English Composition (English 101) was chosen for analysis / 
because it is one of the two courses required of all baccalaureate students 
for graduation. A computer program specifically written for analysis of 
course enrollments by students' levels and colleges orovided the summary 

enrollment picture. This program provided computer output, an example of 

\ 

winch is shown in Exhibit 2. - s 
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Enrollment summaries in English 101 were gathered for fall quarters of 
1969, 1970, and 1971 and are shown in Exhibit 3. Also shown in Exhibit 3 is 
the headcount of all entering freshmen from the fall quarter for the three 
years under study. The percentage distribution in the course by class rank 
shows that a constant percentage of entering freshmen are enrolling in 
English 101 in the fall quarter of each year—namely, about 27% of them. 

EXHIBIT 3 



1969 



1973 



1971 



Fall entering frelshmen 
enrolled in English 101 



Fall entering freshmen- 
total headcount 



2 f 99Z 



868 



3,153 



777 



2,882 



% of entering freshmen 
enrolled in English 101 



27.8 



27.5 



22.0 



Exhibit 4 utilizes the same data and breaks down the freshmen into two 
groups— those enrolled through the professional schools arid those enrolled 
through the Arts and Sciences College. It is evident that this breakdown, 
even though we are still dealing with large numbers, does not afford us the 
consistency found in Exhibit 3. In the three years under analysis, the per- 
centage of entering freshmen 1n professlbnal schools that enrolled for English 101 
in that fall quarter varied from 18.5* to 24.5X. Similarly, the Arts & Sciences 
College entering freshmen percentage varied from 36.3% to 40.9%. Therefore use of 
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EXHIBIT k 



Fall entering freshmen 
enrolled in English 101- 
Professional Schools 



1262 



529 



1970 



-»80 



121L 



331 



Fall entering freshmen 
enrolled in English 101- 
Arts and Sciences 



303 



388 



U*6 



Fall entering freshmen 
enrolled in English 101 — 

All 8J| 8J| 221 

\ 

Fal 1 entering If reshmen — 

Professional Schools x 2,158 2,20-» 1 i788 

\ ■ ' 

Fall entering freshmen — v 

Arts and Sciences 83k 9**9 1.09 1 * 



Fall entering freshmen — 

All 2,992 



% of entering freshmen 
enrolled in English 101 
Professional School s 



\ 



% of entering f reshmen 

enrolled in English 101 — 

Arts and Sciences 36*3 



21.8 



j{0.2 



2.882 



18.5 



-♦0,8 



% of entering freshmen 
enrolled in English 101* 
All • 



27.8 



2Zti 



2JN0 



\ 11 



/ > 



ERLC 



-fl- 
an ICLM on English 101 for entering freshmen is more difficult and calls for 
more judgment when' the college of enrollment is known even to the limited ex- 
tent of Arts and Sciences vs. all others (professional schools). ( 

Exhibit 5 carries this^anaTysis one step further to indicate the results 
when the college of enrollment in the professional schools is known. The re- 
suits of this analysis are startling. Three years ago, /entering freshmen in 
Business Administration took English 101 at. the rate of 54.1%; in 1971, only 
6.2% of the College's entering x freshmen took English 101 in fall quarter. En- 
gineering's percentage of participation dropped slightly, whereas Education 
an'4 Pharmacy entering freshmen increased their rate of oartici^ation 1n English 1( 

EXHIBIT 5 



Entering freshmen enrolled in pnglish 101 

Arts and Sciences / 

Business Administration 

Education 

Engineering 

Pharmacy 

Other 

TOTAL 

Entering freshmen- -total 

Arts and Sciences 

Business Administration 

Education \ 

Engineering , 

Pharmacy \ 

Other \ 

TOTAL 

% of entering freshmen 
enrolled in Enqlish 101 

Arts and Sconces 
i Business Administration 
Education 
Engineering 
Pharmacy 

Other 4 *) 

TOTAL 1* ' 



1969 1970 1971 



\ 



303 


388 


446 


173 


38 


17 


342 


427 


219 


7 


4 


1 


0 


8 


13 


7 


3 


1 


S3T 


558" 


zzz 


834 


949 


1,094 


320 


280 


/275 


682 


109 


491 


243 


283 


188 


41 


56 


73 


872 


876 


^ 161 


2,492 


3,153 , 


2,882 



36.3 


40.9 


40.8 


54.1 


13.6 


6.2 


50.1 


60.2 


60.9 


2.9 


1.4 


r.5 


0.0 


14.3 


1/.8 


0.8 
2TB' 


0.3 
2775" 
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The consistency of performance decreases as the levels of disaggregation 
increase and the incorporation of data into the ICLM requires more value judg- 
ment and asftimatj&i. 

ExroLbi*^ shows a further complication in our efforts to utilize ICLM 
in resource allocation. This shows that the percentage of students enrolled 
in English 101 that are entering fre"' * not constant over time. In 1969, 
85. 1% of the students in English 10 e entering freshmen, whereas, in 197*. 
73.9% of them were entering freshmen. Tne record of participation by college 
' isTeven more inconsistent. For example, where entering freshmen in Business 
'Administration once made up 17.7% of the population in English 101, they now 
make up only 1.6%. 

There are some explanations^ of why Exhibit 6 shows what it does. (1) 
Administratively, the Jecision was made to keep the total enrollment 1n Eng- 

\ 

\ 

lish 101 the same (roughly) as it was the previous year, even in the face of a 

i i, 

failing enrollment of entering freshmen. (2) The opportunity for cpntinulng ^_ 
?*udents (holdover freshmen and other) to register for English 101 for Fall 
Quarter 1971 *a£ increased due to a change in the registration system. In Fall 
Quarter 1970, entering freshmen had first choice for the course; 1n Fall Quar- 
ter 1971, the continuing students had first choice. (3) Business Administra- 
tion decided to -defer* where possible, their students' enrollments Into Eng- . 
lish 101 beginning with Fall Wuarter 1970. 

Decision (1) above, in part, brought about the opportunity for more stu- 
dents relative to the student population to enter Engr-h 101. This, when 
coupled wUfTdecJsi-on (2) above, allowed the participation of entering freshmen, 
in total, to reach the leveli of other years, after providing capacity for^stu- 
dents who had deferred Engli|h 101 and now wished to enroll. Decision (3) above 
\ . ^ _ ■ 

13 \ 
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brought about, in part, the shifts in class make-up by college, because the 
seats that Business Administration no longer controlled filled with students 
from other colleges. 

^ Exhibit 7 shows our attempt to find analytic, meaning in the enrollments \ 
for Fall Quarter 1969, 1970, and 1971, in the only other university-wide re- 
quvrement--Physical Education 108. The percentage of entering' freshmen in total 

♦ 

varies from 20.3 in 1969 to 26.1 in 1970. Analysis by college of enrollment 
shows fluctuations far greater than that revealed by the analysis of English 101 
data. As withVEnglish 101, the more you know about the student (in this case, 
only the college of matriculation), the less the ability to_ flndjwialytlc me aning. 

EXHIBIT 7 

1969 1970 1971 

Entering freshmen enrolled 
in Physical Education 108 

Arts and Sciences 262 379 400 

Business Administration . 140 174 156 

Education 295 507 326 

Engineering 51 *i "*t 

PI.Sm.cy 30 32 25 

TOTAL ! H 1M f M 

Entering freshmen— total 

Arts and -Sciences * 834 949 1,094 

Business Administration 320 280 275 

Education 682 709 491 

Engineering 243 283 188 

Pharmacy 41 56 /J 

Other 872 876 761 

TOTAL SM 1^53 2,882 

% of entering freshmen 
enrolled 1n Physical Educ. 108 

Arts and Sciences 25:3 31.4 27.3 

Business Administration 38.1 46.8 43.3 

Education 32.1 50.8 44.2 

Engineering 14.4 1.4 3.7 

Pharmacy 7.3 50.0 30.1 

Other 2.1 0.1 ■ 0.8 

TOTAL 15 20.3 26.1 23.2 
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Exhibit 8 shows that entering freshmen do not make up a constant percent- 
age of the total enrollment, providing 74.5% in 1969, 73.7% in 1970, and only 
68.9% in 1971. As soon as we look at the college of enrollment, the data pro- 
vide less consistent information from year to year— the same situation we ex- 

perienced with English 101. 

Administrative decisions on total 'enrollment and changes in registration 
procedures, as alluded to earlier, affect the actual enrollment of students in 
Physical Education 108. Furthermore, also operating on the system is the nature 
of these courses. That is to say, English 101 is a prerequisite for other 
courses and knowledge of the fundamentals of composition is presumed in many 
other courses (history term papers, for example). Physical Education 108, on 
the other hand, is considered by many students as a "filler" course, to be 
taken any time during the college experience; hence, no particular rush to en- 
roll duriog the first quarter. 

College-wide requirements of three professional schools were identified 
and their enrollments analyzed. It was presumed that if the enrollment data 
had more meaning at this level of disaggregation, then further breakdowns, 
such as to major, would provide even greater analytic meaning. If the college- 
wide requirements provided data that had less meaning than that found in- the 
two yniversity-wide requirements, then to analyze at the level of major would 
provide less meaningful data yet. 

Exhibit 9 shows enrollment data for Operations Analysis 119, a college- 
wide requirement for the College of Business Administration. This exhibit 
shows that entering freshmen participated at a rate of 29.7% in 1969, 31.1% in\ 
1970, and 73.1% in 1971. However, of the total students in the course, in 



o 4 17 
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1969 % 47.5% were Business Administration entering freshmen, in 1970, 33.0% 
were Business Administration entering freshmen, and in 1971, 48.1% were Busi- 
ness Administration entering freshmen. Students from other colleges provided 
8.5% of the total enrollment in 1969, 5.2% in 1970, and 8.4% in 1971. This 
analysis provides us with information that is far less consistent thai that 
found in English 101, and somewhat less than that found in Physical Education 
108. - 

Exhibit 10 shows enrollment data for Foundations 130, a colleqe-wide re- 
quirement for the College of Education. Entering freshmen in the college parti- 
cipated at a rate of 34.2% in 1969, 40.5% in 1970, and 44.0% in 1971. Of the 
total students in the course, in 1969, 38.0% were entering freshmen from Edu- 
cation, in 1970, 49.7% were entering freshmen from Education, and in 1971, 57.3% 
were entering freshmen from Education. Students from other colleges provided 
10.8% of the course enrollment in 1969, 8.0% in 1970, and 9.5% in 1971. This 
analysis seems to show a consistency approximately that of Physical Education 108. 

Exhibit 11 shows enrollment data for Graphics 121, a college-wide require- 
ment for the College of Engineering. Entering freshmen in the college partici- 
pated at a rate of 90.9% in 1969, 92.2% in 1970, and 95.7% in 1971. Of the total 
students in the course, 78.1% were entering freshmen from Engineering in 1969, 
81.3% were entering freshmen from Engineering in 1970, and 81,8% were entering 
freshmen from Engineering in 1971. Students from other schools provided 6.7% 
of the enrollment in 1969, 4.7% of the enrollment in 1970, and 7.3% of the en- - 
rollment in 1971. This analysis Indicates that the enrollment situation in 
Graphics 121 1s no more stable and predictable than that of either the college- 
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wide requirements analyzed (Operations Analysis 119 and Foundations 130) or 
the university-wide requirements (English 101 and Physical Education 108). 

Even though our assumption of "less information yields more analytic 
meaning" seems to be proved true when analysis moves from class rank only to 
college and class rank, it was felt that an inspection of data by major, by 
rank, by college was necessary to further substantiate these findings. Exhib- 
it 12 shows the layout, with examples, of a computer program designed to ex- 
tend the search performed by college and rank (see Exhibit 2) to search also 
for the major of each student enrolled. A comparison of this information with 
that contained in the "Report on Student Enrollment," published quarterly by 
the Office of Admissions and Records will show any consistency that may exist 
that will aid us in finding analytic meaning in enrollment data. Even though 
this information is available on all levels of students, only entering fresh- 
men are displayed 1n Exhibit 13 as to English 101. 

EXHIBIT 12 V V * 
COURSE ENROLLMENTS BY MAJOR AND BY CLASS RANK, FALL 1971 

SEPT JAN APRIL HOLD / 
COURSE NBR MAJOR FRESH FRESH FRESH FRESH SOPH JUN SEN UWD MAST DOCT OTHER TOTAI 

113-101-00 100 2 2 4 

103 16 2 18 

112 214 , 35 6 1 I 256 

113 9 9 
115 5. 1 6 



484 7 4 1 12 

600 13 13 

601 4 



702 __ ___ _ 1_ 

COURSE TOTAL 777 211 51 10 2 1 1052 
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Arts & Sciences 



EXHIBIT 13 

MAJORS ENROLLEO IN ENGLISH 101 
ANO TOTAL MAJORS -ENTERING FRESHMEN 



J2ZS. 



Enrolltd Total 



1971 



Enrolled Total 



ERLC 



Undecided 


121 


236 


51.3* 


2 


5 


J*0*0 


Art 


19 


32 


59. ^ 


16 


36 




General i 


65 


138 


*7.1 


215 


382 


56.3 


English 


13' 


20 


65.0 


10 


10 


100.0 


Predentistry 


k 


9 




$ 


12 


M.7 


French 


2 


k 


50.0 


1 


3 


33,3 


Premedical 


17 


51 


33.3 


29 


96 


30.2 


German 


0 


0 


00.0 




3 


33.3 


Interdepartmental 


0 


1 


00.0 


"3 


5 


60.0 


Hi story 


10 


22 


^♦5.5 


" 


19 


57.9 


Journal ism 


15 


25 


60.0 




23 


56.5 


Music 


1 


9 


11.1 


3 


17 


17*6 


Phi losophy 


0 


2 


00.0 


3 


5 


60.0 


Spani sh 


2 


3 


66.7 


<, 0- 


3 


L 
00.0 


j 

Speech i 


3 


k 


75.0 


2 


1. 
«♦ 


50*0 


Theater 


1 


8 


12.5 




20 


35.0 


Biology 


11 * 


29 


37.9 




w 


38.6 


Chemistry 


5 


12 


M.7 


" 


25 


M».0 


Geology 




1 


100.0 


2 


2 


100.0 


Mathematics 


15 


35 


J«2.9 


5 


15 


33.3 


Medical Technology 


19 


25 


76.0 




28 


32.1 


Physics 


5 


10 


50.0 


5 


9 


55.6 


X-Ray 


0 


<t1 


00.0 




36 


00.0 


Anthropology 

i 


0 


0 


00.0 




2 


00.0 


Economics 


0 


1 


00.0 




2 


50.0 


* 

Geography 


0 


J 


00.0 




1 


00.0 


International Relations 


0 


0 


00.0 




1 


00.0 


Political Science 


6 


16 


37.5 




28 


67.9 


Psychology 


25 


35 


7L<* 




60 


51.7 


Sociology 


27 




58.7 




*3 


53.5 


Nursing 






2 r 




lii 


01.1 



EXHIBIT. 13 (cont.) 







1970 






1971 






Enrol lad 

LIU Ul 1 QV 


1 OH 1 


— S 


Enrol led 


Total 


% 


Total Arts & Sciences 


368 


9*9 


!££ 








Business Administration 














General 


27 




lift 


13 


2h1 


05. H 


Accounting 


6 


111 


1 7 A 

1 / .0 


3 


20 


15*0 


Admi nistration 






1 C 1a 


0 


2 


00t0 


Personnel 


1 


1 


100.0 


0 


1 
1 


ftft ft 


Business Economics 


0 


1 


00.0 


0 


1 


00.0 


Finance 


0 


7 


00.0 


0 


3 


00.0 


Marketing 


2 


in 


1^.3 


1 


3 


,33.3 


Office Administration^ 


0 


1 


00.0 


0 


3 


00.0 


Operations Analysis 


J) 


1^ 


00.0 . 


_o 


I 


00.0 


Total Business Admin. 




280 


13.6 


il 


m 


06.2 


Education 














Undecided 


MO 


i in 
1 /u 


DO. 2 


111 
Hi 


62 


50.0 


Educational Media 


9 
c 




100.0 


0 


0 


00.0 


Early Chi Idhood 


1 7 




7ft A 
/U .0 


0 


0 


00.0 


Elementary Education 




zzu 


An ft 


1 9*1 

127 


162 


69*8 


English 


^o 


CI 
7/ 


A t 9 

03.2 


21 


27 


77.8 


Foreign Language 




2/ 


**0. 1 


0 


13 


h6.2 ' 


Curriculum & Teaching 


1 c 
' 7 




iQ ft 


0 


0 


06 .0 


Ma thema tics 


9Q. 




0*4 • *4 


1*4 


26 


53*8 


/ 

Science / 




3 


00. / 




6 


66.7 


Speech / , — 


u 


3 


00.0 


1 


1 


100.0 


Social Science / 


1 1 

1 1 




37-9 


0 
O 


18 


kk.k 


Spec i a 1 E ducat i on / 


ft 
o 


1 3 


61 .> 




27 


51 .9 


Secondary Education , 


0 


1 


00.0 


7 


B 


87.5 


Health - — -/-- - 


0 


3 


00.0 


1 


1 


100.0 


Library Science 


v 2 


2 


100.0 


1 


1 


100.0 


Physical Education 


5 


21 


23.8 


3H 


<* 


73.9 


Vocational Education 


1 \ 


7 


1<*.3 


0 


5_ 


00.0 


Art Education 


2k 


31 - 


77.* 


12 


2k 


50.0 
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EXHIB IT 13 (cont.) 







1970 






i?7i 






Enrol led 


Total 


% _ 


Enrol led 


Total 




•duration fcont.) 










r V 




Diicinocc PHi if m 1" 1 fin 
DUSi ncSa CUUtfll I vii 


11 


22 


50.0 


6 


1 1 


5fr.5 


Mi i c i* r PHi ir.a i fin 




10 


10.0 * 


2 


13 

r 


15.fr 


lOtoi tuucoi i un 


427 709 


60.2 


299 


491 


60.9 


. i 

Engineering 














Unclassified 


3 


83 


03.6 


0 


3 


00.6 


Chemical Engineering 


0 


37 


00.0 


0 


4 30 


00.0 


Civil Engineering 


0 


33 


00.0 


0 


36 


00.0 


Electri cal Engi neer i ng 


0 


62 


00.0 


1 


58 


01.7 


Engineering Science 


0 


0 


00.0 


0 


7 


' 00.0 


1 Engineering Physics 


1 


10 


10.Q 


0 


0 


00.0 


Industrial Engineering 


0 


10 


00.0 


0 


7 


00.0 


M*rhanica1 Enaineerina 
Total Engineering 


0 

fr 


J48 

283 


00. 0 

01. fr 


0 

1 


188 


00.0 
00.5 


Pharmacy 


i 

8 


H 


M 


11 




iM. 


Other 


/ 

2 


876 


00.3 


I 


m. 


00.1 


University Total 


m 


3.1S3 




ILL 


2.882 


27.0 
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Exhibit 13 shows that the percentage of participation in English 101 
in the fall quarters by student major for entering freshmen varies widelv 
from 1970 to 1971. As such, it is obvious that knowledge of a student's 
major makes prediction of enrollment in English 101 even more difficult than, 
knowing only students' college. And knowing the college, you will recall, 
made enrollment prediction more difficult than mere knowledge of student rank./ ' 

Retention and Attrition Analysis Possibilities . / 

From the preceding consideration of the^ enrollment dat* and the Induced 
Course Load Matrix it appears evident that; the ICLM is best suited to macro- 
level analysis and decision-making. It remains to be seen whether there are 
micro- level tools that can be employed to yield analytic results when applied 

to enrollment data. 

A critical area of decision-making is that of retention and attrition. 
To get an analytical handle on this problem every freshman entering the Uni- 

v 

versity of Toledo in the fall' of 1969 was followed up through his or her 
course registrations in that fall quarter a>td subsequent quarters. Some idea 
of the magnitude o* thts task can be seen when it is realized that the 2,992 
entering* freshmen develop almost 68,000 # individual course registration records 
to be scrutinized in the course of ten quarters records available on computer , 

tape. I i 

In terms of a manageable size for analysis in this oaper, there were five 
samples, each of 100 students, drawn from a complete listing of the 2,992, rep- 
resenting five units of contiguous pages in the computer printout. This print- 
out was ordered by social security number and the selection of groups of pages 
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that comprised the five samples included the first forty pages of listinqs, 
three other groups of pages from the page 300, page 600 and j^age 800 segments 
of the printout, plus a final unit of pages from the end of ihe printout. In 
the social security number system the only possible bias could arise from the 
local student's numbers tending to cluster with possible adverse effects on 
the ultimate representativeness of the sample. In terms of representativeness, 
the following table may be instructive: 



EXHIBIT 14 
Distribution>ef*TrHhmen, Fall 1969 



/ 




/ 

Arts and Science 

Business Administration 

Education 

Engineering 

Pharmacy 

Comm. Tech. 



Actual College 
Percent Enrollment 

27.9* 
10.7 
22.8 
8.1 
1.4 
29.1 
ISO* 



Sample College 
Percent Enrollment 

29.8% 

11.0 

20.6 

8.4 

1.0 

' , 29.2 
TBO* 



1 

signifi< 



One of the first findings of analytic significance in the sample of 500 
involved in this undertaking was the size of the "non-consecutive" enrollment 
group. It has become popular to point out the drop-out, step-out ohenomenon. 
As of the present sample it involved almost 1Z% of the entering freshman group, 
+ Jlucfi more work is programmed to be done on this sub-population, but present; 
findings suggest that the in-and-out, here today-gone next quarter-back some- 
time later, behavior may contribute to the difficulty ifi using forecasting 
tools that have in earlier years yielded adequate results. We found that some 
students were registered, and then not registered and then returned as many as 
three separate times in the ten quarters studied. Their leaving did not appear 
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to be associated with grade difficulties and a separate inquiry is planned to 
attempt to learn something of the reasons for their behavior. 

The complete detail of student registration in terms of the total sample 
is given in Exhibits 15 S 16. 

EXHIBIT 15 



Number of Students Registering in Consecutive Quarters 



No. of Consecutive 






Sampl es 






Total All 


Qtrs. of Registration 


I 


2 


3 


4 


5 


Sampl es 


i ' 


6 


15 


17 * 


13 


4 


55 


2 


3 


7 


6 


2 


3 


21 


3 


21 


13 


8 J 


8 


13 


63 


4 


1 


2 


3 


6 


4 


16 


5 


4 


5 


8 


b 


4 


26 


6 


14 


7 


4 


11 


8 


44 


7 


2 


3 


5 


5 


6 


21 


8 


3 


2 


5 


3 


7 


20 


9 


37 


16 


20 


22 


31 


126 


. 10 


3 


7 


8 


6 


10 


34 


Non-cdnsecutive 


6 


23 


16 


19 


10 


74 


Total 


TOO" 


TB0~ 


TM 


Too" 


TOO" 





EXHIBIT 16 



J 



Percent of Students Registering in Consecutive Quarters 



No. of Consecu- 












Reverse 


tive Qtrs. of 






• 1, 2, 


1,2,3 


Cumula- 


Cumula- 


Registration 


1 & 2 


1,243 


3 & 4 


4 & 5 


tive All 


tive All 


1 ! 


10.5 


12.7 


12.7 


11.0 




100.0 


2 


5.0 


5?3 


4.5 


4.2 


15.2 


89.0 


3 


17.0 


14.0 


12.5 


12.6 


27.8 


84.8 


4 


1.5 


2.0 


3.0 


3.2 


31.0 


72.2 


5 


4.5 


5.7 


5.5 


5.2 


36.2 


69.0 


6 


10.5 


8.3 


9.0 


8.8 


45.0 


63.8 


7 


2.5 


3.3 


3.7 


4.2 


49.2 


55.0 


8 


• 2.5 


3.3 


3.3 


4.0 


53.2 


50.8 


9 


26.5 


24.4 


23.8 


25.2 


78.4 


1 46.8 


10 


5.0 


6.0 


6.0 


6.8 


85.2 


21.6 


Non-consecutive 


14.5 


15.0 


16.0 


14.8 


100.0 




Total 


100.0 


100.0 


160.0 


100.0 
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When the registration of this student sample is feonsidered^U^terms of 
the college of initial registration the data looks like Exhibit 17. From this 
it is possible to construct the tables found in Exhibits 18, ig and 20. 

EXHIBIT 17 

Number of Students Registering in Consecutive 
Quarters by College of Initial Registration 



No. of Consecu- 
tive Qtrs. of 
Registration 

2 
3 
4 
5 
6 
7 
8 
9 

10 

Non-consecutive 
Total 



Arts & 
Science 

15 
6 

20 

4 

1 
23 

4 

4 

38 
10 
24 
149 



Bus. 
Adm. 

6 
0 

'6 
1 
7 
4 
1 
4 

16 
4 

e 

55 



Educa- 
tion" 

6 

3 

14 

5 
7 
8 
1 
2 

34 

1? 
11 
103 



Engi- 
neerinq 

5 
1 
5 
0 
1 
0 
3 
0 

20 

4 

3 
42 



Phar- 
macy 

1 

0 
1 

0 
0 
0 
0 
0 
3 
0 
0 
5 



Comm. 
Tech 

22 
11 
17 

6 
10 

9 

12 
10 
15 
4 

30 
146 



Total 

55 
21 
63 
16 
26 
44 
21 
20 

126 
34 
74 

500 



The table in Exhibit 18 treats each college separately as well as the 
sample as a whole. It is at least interesting, if not predictive, to note that 
overall 11. OX of the sample leave after just one quarter of registration. Arts & 
Science, Business Administration and Engineering Colleges each are close to that 
norm. The Education College is quite a bit under the 11. OX. ,rm-Tech College 
is slightly higher. The nymber of students involved in the Pharmacy College 
data is too small to draw any conclusion's, even tentative ones. 

There are many more analytic elements to the table in Exhibit 18. One 
more will suffice to illustrate' the possibilities in this simple technique. It 
is evident that students tend to stay registered for some multiple of th/ree quar- 
ters, {three, six or nine quarters). From the standpoint of looking at reten- 
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tal sense than those who leave sooner. In this dimension the professional ol- 

leges of Pharmacy, Engineering, Education and Business Administration, in that 

order, do the best job of retaining students while the Arts & Sdience College 

almost exactly reflects the norm set by the entire sample. 

EXHIBIT 18 ! r 

Percent of Students Registering in Consecutive 
Qtrs. by College of Initial Registration 

No. of Consecu- I 



ve Qtrs. Of 
gistration 


Arts & 
Science 


Bus. 
Adm. 


Educa- 
tion 


Engi- 
neering 


Phar- \ 
macy 


Comm 
Tech 


Total 


1 


10. 150 


*10.9% 


5.8% 


12.6% 


20.0% , 


15.2% 


11.0% 


2 


4.0 


0 


2.9 


2.4 


0 1 


7.5 


4.2 


3 


13.4 


10.9 


13.6 


11.9 


20.0 \ 


11.6 


12.6 


4 


2.7 


1.8 


4.9 


0 


o 


4.1 


3.2 


5 


.7 


12.7 


6.8 


2.4 


\ 0 : 


6.8 


5-,2 


6 


15.4 


7.3 


7.8 


0 


0 \ 


6.2 


8.8 


7 


2.7 


1.8 


.9 


7.1 


0 i 


8.2 


4.2 


8 


2.7 


7.3 


1.9 


0 


0 • 


6.8 


4.0 


9 


25.5 


29.1 


33.0 


47.6 


60.0 


10.3 


25.2 


10 


6.7 


-7.3 


11.7 


9.5 


0 ( 


2.7 


6.8 


i-consecutive 


16.1 


10.9 


j 10.7 


7.1 


0 


20.6 


14.8 


Total 


100.0% 


100. OX 


100, OX 

/ 


100.0% 


100. p% 

r 1 


100.0% 


100.0% 



The most productive use of Exhibit 19 is probably to be found in the dif- 
ferential it makes plain as to non-consecutive enrollment. It is at least ten- 
able in the light of tlys data to suggest that a highly /structured program, such 
as found in Pharmacy, Engineering, Education and Business Administration Colleges 
does not lend itself to easy in-and-out behavior, while' the Arts & Science and / 
Comm-Tech Colleges have more of a cafeteria choice whic'h ^ay make in-and-out 7 
behavior not only more possible but more palatable. I 
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EXHIBIT 19 



Selected Cumulative Percents of Students Registering 
In Consecutive Quarters by College of Initial Registration 



No. of Consecu- 
tive Qtrs. of 
Registration 


Arts & 
Science 


Bus. 
Adm. 


Educa- 
tion 


Engi- 
neering 


Phar- 
macy 


Comm 
Tech 


Total 


3 or fewer 
6 or fewer 
10 or fewer 
Non-consecutive 


27.5X 
46.3 
83.9 
16.1 


21.8% 
43.6 
89.1 
10.9 


22.3% 
41.8 
89.3 
10.7 


, 26.3% 
28.7 
92.9 
7.1 


40.0% 
40.0 
100.0 
0 


34.3% 
51.4 
79.4 
20.6 


27.8% 
45.0 
85.2 
14.8 



At least one way to view Exhibit 20 is to compart the total percent listed 
for each College column with the individual percent values entered in a given 
column. Thus Business Administration has 11.0% of the sample (10.7% of actual 
freshmen enrollment) but has less than 11.0% of the dropouts after guarters num- 
bered 1, 2, 3, 4, 6, and 7; and less than 11.0% of, the non-consecutive regis- 
trants. But Business Administration has 26.9% of those who leave after five 
quarters and the guestion naturally follows, Why this^ulge, then? The Engi- 
neering College has 8.4* of the sample (8.1% of actual freshmen enrollment) but 
has less than 8.4% of the dropouts after guarters numbered 2, 3, 4, 5, 6 and 8 
and less than 8.4% of non-consecutive registrants. But Engineering has 14.3% 
who drop out after seven guarters and the same guestion as before needs an- 

if 

swering. 
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EXHIBIT 20 \ 



\ 



Arts & 


Bus. 


Educa- 


Engi - 


Phar- 


Comm 




Science 


Adm. 


tion 


neering 


macy 


Tech 


Total 


27.3% 


10.9% 


10.9% 


9.1% 


1.8% 


40.0% 


100.0% 


28.6 


0 


14.3 


4.7 


0 


52.4 


100.0 


31.8 


9.5 


22.2 


7.9 


1.6 


27.0 


100.0 


25.0 


6.2 


31.3 


0 


0 


37.5 


.jO.O 


3.8 


26.9 


26.9 


3.8 


0 


38.6 


100.0 


52.2 


9.1 


18.2 


0 


0 


20.5 


100.0 


19.0 


4.8 


4.8 


14.3 


0 


57.1 


100.0 


20.0 


20.0 


10.0 


0 


0 , 


50.0 


100.0 


30.2 


12.7 


26.9 


15.9 


2.4 


11.9 


100.0 


29.4 


11.8 


35.2 


11.8 


0 


11.8 


100.0 


32.4 


8.1 


14.9 


4.1 


0 


40.5 


100.0 


29.8 


11.0 


20.6 


8.4 


1.0 


29.2 


100.0 



Percent of Students Registering for a Given Number 
Of Consecutive Qtrs. by College of Initial Registration 

No. of Consecu- 
tive Qtrs. of 
Registration 

1 

2 
3 
4 
5 
6 
7 
8 
9 
10 

Non-consecutive 
Total 

The outcome of the kind of attrition and retention analysis that this sam- 
ple data makes possible is a matrix of coefficients from which it-is possible to 
predict the distribution of other sets of matrix data. This approach builds on 
the early work of Leontif of Harvard and his work in input-output analysis. 
The adaptations of this in enrollment data terms have been used with some suc- 
cess in making academic planning decisions. 5 One of the most effective efforts 
at finding a technique that will overcome the limitations of the ICLM seems to 
have been attempted at Pennsylvania State University by R. D. Newton and E. E. 
Enscore. They reasoned that coefficients, not unlike those 1n Exhibit 21 based 
on the current sample, may need modification. They have reported on their use 
of four modifying techniques, moving averages, exponential smoothing, exponen- 
tial smoothing with trends, and least squares fit. 6 Still other efforts have 
encompassed measures of transition probabilities and updates of the transition 
probabilities through time. 7 \ 

s 

' 32 
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No single effort has as yet completely solved the basic forecasting prob- 
lem inherent to the data involved. What is present seems to be the same kind^ 
of market forecast problem faced by corporations vending any product or ser- 
vice, with the added difficulty that since higher education is a personal ser- 
vice vended by an institution, the predictability of product characteristics 
and consumer response to them is not as readily attainable. The work of such 
researchers as Burnham 1 into the reasons for student response to course offer- 
ings seems to be an important breakthrough. Some of the work that seems most 
promising is that of Smith & Wagner,' George B. Weathersby, 10 Sanderson, 11 
and Oliver and Hopkins. 12 It is undoubtedly appropriate to recognize that the 
earliest analysis of the ICLM and its deficiencies came from the work of Jew- 
ett lJ and his associates at Humboldt State in the California system. 
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EXHIBIT 21 
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The coeffici|nts in Exhibit 21 have been applied to University of Toledo 
data with the following outcome: 
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EXHIBIT 22 

Application of Matrix Coefficients 
Given a class of 2,992 incoming freshmen 



Beginning of quarter There will be left 

2 2,663 

3 * 2,537 

4 2,160 

5 « 2,064 

6 1,909 

7 1,646 

8 1,520 

9 1,400 

It should be realized that each of the figures above can be affected by the 14.8* 
that represents in-and-out (non-consecutive) registrants. The probable maximum 
is 443 students and the likely impact is 220 students. This is true because the 
in-and-out group is treated here as a random variable. The present data in the 
sample" does not appear to warrant further analysis although further analytic 
treatments are planned for the entire population when such becomes available in 
compatible form for further computer manipulation. 

Even before the sample data utilized above in matrix coefficient fbrm 
became available, a regression study had been undertaken using three years of 
data. The outcome of these equations is given in the exhibit that follows. 
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EXHIBIT 23 



Application of Regression Coefficients 
Given a class of 2,992 incoming freshmen 

Year There will be on hand 

Sophomore 2,844 

Junior 1,768 

Senior 1,390 
The numbers projected above are not intended to be directly comparable to the 
figures in Exhibit 22. The data above reflects the number expected to be on hand 
with a given number of credit hours that qualify the student to be ranked as a 
sophomore, junior or senior. The data in Exhibit 22 refers solely to the con- 
secutive character of registration and not to the number of credit hours taken. 
Inspection of the data indicates that some of the students with records of nine 
or ten consecutive quarters of registration have registered for as little as a 
single course in each quarter, thus after ten quarters of registration their 
credit hour totals might still fall short of ranking as a sophomore. ^ 

This distinction, cited above, may be of considerable significance in 
analytic interpretation of enrollment data. Too often in the past attention has 
been paid solely to the achievement of certain credit tiour totals. It may well 
be of greater significance to know the consistency with which a student partici- 
pates in the higher education experience. This would be in parallel with the 
findings in marketing as to the importance of brand loyalty and patronage loy- 
alty in the market position of a product or the share of the local market of a 
retailer. 
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Longitudinal Research Possibilities 
The more the data on enrollment is studied the more it becomes evident 
that the data reflect decisions in a time setting. The decisions represented 
•by a course registration sum up a variety of personal experiences and peer 
group forces operating in little understood ways upon each student t6 effect 
the datum we see in enrollment matrices. But it appears certain that the stu- 
dent experiences and peer group influences do nyot operate in an instant 'of 

time. They appear more likely to be ^cumulative and thus it begins to apoear 

/ 

that the issue for analysis is not that of macro-analysis versus micro-analysis 

" " * 1 I 

but rather that the research imperative is fo^ longitudinal study as opposed 
to cross-secticnal analysis. By its very nature, longitudinal study requires 
a micro-analytic type of approach. The situation seems much like that which 
has faced marketers for some tirye and in which market research has made some 
contributions. 

Before becoming too enamt/ured with the idea of longitudinal research it 
^emed prudent to examine what could be learned in the present instance from 
the data on the entering freshmen of Fall, 1969. In one of several computer 
runs, data was printed on the college and major as of each quarter and the 
courses registered and taken in that quarter and subsequent quarters. The sec- 
ond author of this paper serves on the faculty of a Department of Operations 
Analysis. It was of particular interest, thus, to examine the thirteen majors 
in Operations Analysis. Of these thirteen students, none declared an Opera- 
tions Analysis major as an entering freshman. Four of the thirteen came from 
the "Business-Undecided" category, four more came from specific Engineering 
college categories, two each came from freshmen who entered specifying Arts & 

Science and Comm-Tech, while the remaining one originally chose to matriculate 

f 



in Education. There does not seem to be any pattern as to the time when selec- 
tion of a major (oir a new major ) is made by these students. Two of the thir- 
teen, as matter of fact, are the in-and-out variety of student. The first 
of these ^>egan as a "Business-Undecided" student, took one quarter, then stay- 
ed out two quarters, came back for another, stayed out one more quarter, came 
back for this third quarter of registration, then left and has remained out 
o^school for the remaining four quarters in the current analysis. The other 
non-consecutive registrant originally chose Engineering as a major, attended 
three quarters, then dropped out for four quarters, then returned and has been 

registered in each of the last three quarters in the current analysis. In each 

» 

of these cases there is no apparent grade difficulty. Each of them made a 
change of major after returning from being out of school. The quarters when a 
change of major was registered vary all over the time span available in this 
analysis. The remaining three Business students declared themselves in the' 5tK, 
6th and 7th quarters, while the remaining three Engineering students changed 
to the College of Business Administration and an Operations Analysis major in 
the 3rd, 9th and 10th quarters. Neither of the junior college (Comm-Tech) stu- 
* dents waited until they had completed six quarters there, but made their choice 
in the 4th and 5th quarters. The two Arts & Science students made their change 
of major and college 1n the 7th and 8th quarters while the single Education 
student made a switch in the 9th quarter. Thus, even with something so funda- 
mental as the decision about a college and major we find; 



Quarter in which 

declared change' No. of Students 
in major 

2 1 

3 1 

4 1 

5 3 
' 6 1 
-*~7 2 

8 - 1 

9 2 
i- 10 1 

It would obviously be interesting to learn something of the reasdns for change. 

Both the change to and the change away from factors need research. 

But what we have learned in looking at present data suggests that lack of 

pattern is not limited to any single dimension of the registration process. It 

is a pervasive phenomena the limits of which have yet to be found in the cur- 

U 

rent study. For example, the students referred to above were studied in detail 
as to each registration they made. A similar analysis had been undertaken by 
the second autnor in an earlier study. 1 " At that time, it represented a retro- 
spective cohort analysis type of undertaking. In the present study it was 
possible to view the data in a sequential fashion rather than look back at it, 
considerably after the fact. But whether viewed from the advantage of hind- 
sight or with the immediacy of the sequential happening, the lack of pattern 
is the predominant impression. Exhibit 24 sets forth the sequential retjistra- » 
tion for selected required courses in the College of Business Administration. 
The sample is composed of the thirteen students who became majors in Operations 
Analysis before the summer session quarter of 1972. In general courses num- 
bered 200 or below should be taken, before the 7th quarter, which for these 
entering freshmen of the Fall of 1969 would have been, thus, before the Fall of 
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1971. There are at least 18 instances where these lower division courses have 
not yet been registered for and taken (as of Spring, 1972). In general, no 
300 level or above numbered course would be taken before the 7th quarter of 
registration. There seem to be only two instances where any of these thirteen 
students registered for an upper division course ahead of their standing. 

' Exhibits 25 and 26 sh^jld be considered together. Exhibit 25 represents 
a\sample taken from College of Business Administration graduates of June 1971. 15 



TheV lines connect the registration choices for the group 
larger sample group involved in Exhibit 26 did not lend 



through time. The 
itself to the graphic 



line-drawing of Exhibit 25. The reader of this paper may want to connect some 



of these course registrations through 4 time for himself. 



Try connecting each 



and eve^ry like number. For example, 150 is Accounting 150, the beginning ad- 
counting course. It should be part of every students ffrst or second quarter 
of study in business admini strati on. Other early course registration recom- 
mendations are 190 which can on'ly follow 150 as the second course in beginning 

* • 

accounting, or 119 or the 217-218 pair or 211 and 221. No matter what method 
you adopt in creating the lines connecting these registrations you end up with 
a zig-zag bewildering pattern of lines crossing other lines that demonstrates 
the very lack of pattern that has been the argument of this paoer. 

•i 

Conclusion 

The present study began in an expectation that some of the already devel- 
oped analytic tools when properly tuned could be applied to the data. The in- 
duced course load matrix fails as has been demonstrated. The possibilities for 
developing a probability transition matrix and finding a Markhov. type of solu- 
tion seem less promising now than when the study began. It seems likely that 
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while transition probabilities can be determined for each course for each quarter, 
that the achievement of a steady state is not a near term likelihood. Th» idea 
of using exponential smoothing has considerable appeal. Here again, as in the 
Markhov process, is the possibility for accommodating varying values for the 
coefficient through time. But the achievement of any kind of optimal stability 
in a value for o seems not too likely. 

What appears to the present authors as a possible conclusion is that much 
more needs to be known than is presently known. For example the present data 
awaits further analysis aimed at answering such questions as: Who enrolls for 
what and when? Who is not enrolled at all, who is not enrolled as a college major, 
who is not enrolled in the next course in a sequence of courses or requirements 
and where are they instead of where they were expected to. be-reg is tered. How 
big is the problem of non-consecutive enrollment? How big is\he "leave and 
never return" problem. And ultirjtely, after the descriptive analytics have 
been defined for the entering freshmen of Fall 1969, and for later grouos of en- 
tering freshmen, it will be imperative to get at something as to Why. The final 
element that seems evident now is a study of how answers such as those to be 
sought above can be found in the most timely and efficient manner possible. The 
only conclusion this paper can claim is the conclusion that answers such as 
those sought above cannot be found in the familiar aggregate numbers game. It 
seems more likely that one or more management science tools will play a part in 
the answers to be sought. 
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